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Abstract 

In this paper, we study networks of discrete-time linear time-invariant subsystems. Our focus is on situations where 
subsystems are connected to each other through a time-invariant topology and where there exists a base-station whose 
aim is to control the subsystems into any desired destinations. However, the base-station can only communicate with 
some of the subsystems that we refer to as leaders. There are no direct links between the base-station and the rest of 
subsystems, known followers, as they are only able to liaise among themselves and with some of the leaders. 

The current paper formulates this framework as the well-known reachability problem for linear systems. Then 
to address this problem, we introduce notions of leader-reachability and base-reachability. We present algebraic 
conditions under which these notions hold. It turns out that if subsystems are represented by minimal state space 
representations, then base-reachability always holds. Hence, we focus on leader-reachability and investigate the cor¬ 
responding conditions in detail. We further demonstrate that when the networked system parameters i.e. subsystems’ 
parameters and interconnection matrices, assume generic values then the whole network is both leader-reachable and 
base-reachable. 
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1. Introduction 

Recent developments of enabling technologies such 
as communication systems, cheap computation equip¬ 
ment and sensor platforms have given great impetus to 
the creation of networked systems. Due to their large 
application in different branches of science and technol¬ 
ogy, these systems have attracted significant attention 
worldwide and researchers have studied networked sw- 
tems from different perspectives (see e.g. fl], i], H, 
0 , 0 , 0 , 0 ]). 

In this paper, we consider networks consisting 
of finite-dimensional linear time-invariant subsystems. 
We suppose that each subsystem in the network has 
discrete-time dynamics and the interconnection topol¬ 
ogy among subsystems is time-invariant. In the frame¬ 
work under study, there exists a base-station that can 
only send command signals to some of the subsystems 
with superior capabilities, known as leaders. The re¬ 
mainder of the subsystems referred to as followers can 
only accept input signals from some of the leaders and 


followers. 

Here, we address a fundamental issue associated with 
the above framework namely the reachability. The con¬ 
cept of reachability is well-understood in the systems 
and control literature 0 . We adopt this concept to ad¬ 
dress the following question. 

Under which conditions can the state of followers 
reach any desired values using the commands generated 
from the base-station? 

We tackle this question by providing a mathemati¬ 
cal model for the networked system under study. We 
introduce the notions of base-reachability and leader- 
reachability. Then we show that systems networked 
according to the model considered here are generically 
both base-reachable and leader-reachable. This means 
that when the parameters of the network i.e. parameter 
matrices of each subsystem as well as the interconnec¬ 
tion topology, assume generic values, these properties 
hold. We also investigate some topologies that give rise 
to state matrices with symmetric or circulant structures. 

The problem studied in this paper has some connec- 
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tions with the existing literature concerned with control¬ 
lability of multi-agent systems. There exists a body of 
works in this area and amongmany, interested readers 
can refer to 0, d, m, m, iQ, d, d 
and references listed therein. These references studied 
the controllability problem for a group of single integra¬ 
tors connected through the nearest neighbourhood law. 
We comment on some of the works along this line in the 
next paragraph. 

The controllability problem of multi-agent systems 
was proposed in 0 and the author formulated this prob¬ 
lem as the controllability problem of linear systems, 
whose state matrices are induced from the graph Lapla- 
cian matrix. Necessary and sufficient algebraic condi¬ 
tions on the state matrices were given based on linear 
system tools. Under the same setup, a sufficient con¬ 
dition was derived in d where it was shown that the 
system is controllable if the null space of the leader set 
is a subset of the null space of the follower set. In d, 
it was shown that a necessary and sufficient condition 
for controllability is not sharing any common eigenval¬ 
ues between the Laplacian matrix of the follower set and 
the Laplacian matrix of the whole topology. However, it 
remains elusive on what exactly the graphical meaning 
of these rank conditions related to the Laplacian matrix 
is. This motivates several research activities on illumi¬ 
nating the controllability of multi-agent systems from 
a graph theoretic point of view. For example, a notion 
of anchored systems was introduced in llTIl . and it was 
shown that symmetry with respect to the anchored ver¬ 
tices makes the system uncontrollable. In ifT^ . the au¬ 
thors characterized some necessary conditions for the 
controllability problem based on a new concept called 
leader-follower connectedness. While d was focused 
on the case of fixed topology, the corresponding control¬ 
lability problem under switching topologies was inves¬ 
tigated in d, which employed some recent achieve¬ 
ments in the switched systems literature. Later, the au¬ 
thors of d assumed the graph to be weighted with 
freely chosen entries. Under this setup, they proposed 
the notion of structural controllability for multi-agent 
systems. It turned out that this controllability notion, 
solely depends on the topology of the communication 
scheme; the multi-agent system is controllable if and 
only if the graph is connected. This result is later ex¬ 
tended in il9ll to the case where the dynamics of each 
subsystem are expressed by high order integrators rather 
than a single integrator. The authors of 1201] examined 
the connection between the controllability of networks 
comprising single integrator subsystems and those con¬ 
sisting of subsystems with high order integrators. 

The current paper has several contributions. Firstly, 



Figure 1: The connection structure between the base-station, leaders 
and follower 


in contrast to the works described above, we relax the 
limitation imposed on subsystems dynamics by allow¬ 
ing subsystems to be general discrete-time linear time- 
invariant (DLTI) state space systems. Secondly, in most 
of the literature the followers are connected to one an¬ 
other by the nearest neighbourhood law. We relax this 
constraint here as well. Thirdly, as opposed to exist¬ 
ing literature, we explicity examine the role of the base- 
station and its connections to the leaders. 

The structure of this paper is as follows. In the next 
section, we formulate the problem under study. The 
main results of the paper are introduced in Section [3] 
Finally, Section|4]provides the concluding remarks and 
comments about future research directions. 


2. Problem Formulation 

We assume that there exist N linear subsystems which 
are connected together through linear coupling rules. 
Suppose that there exist Ni subsystems with higher lev¬ 
els of computing and communicating powers that we 
refer to as leaders. The rest of the subsystems are called 
followers denoted by Nf. It is natural to assume that 
the number of leaders is strictly less than the number of 
followers i.e. Nf > Ni. The framework studied in this 
paper is depicted in Fig. [1] 

Without loss of generality, we assume that the first 
Nf subsystems are followers and the remaining N — Nf 
subsystems act as leaders. 

Suppose that the linear state space dynamics of the 
followers are expressed by a set of difference equations 
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as 


For our subsequent analysis it is convenient to define 


M + Biv\, 

w\ = C,xJ, / = 1,.. ■,Nf. 


( 1 ) 


where jcf 6 R"', v\ 6 K'"', wf e We suppose that all 
N subsystems are reachable and observable. The control 
command v\ is constructed based on the following law 




Liiwi 


J=i 


( 2 ) 


Remark 2.1. Note that the control law m allows con¬ 
sideration of both centralized and distributed control 
schemes. If the control law (|2l) is implemented locally, 
then the control gains Ljj corresponding to those sub¬ 
systems which are not neighbors of i-th subsystem are 
assumed to be zero. This ensures that the summation 
Lijwj simplifies into a summation over the neigh¬ 
bor set of i-th subsystem. Hence, the control law (|3 
represents the topology of the network i.e. the matrices 
Lij represent which components of the state vector asso¬ 
ciated with the j-th subsystem are available to the local 
controller corresponding to the i-th subsystem. Thus, 
one can readily verify that the consensus law /EH/ can 
be regarded as a special case of the control strategy (l2]i. 


Af := diag(Ai,...,AA,^), 
Bf := diagiBi,..., Bfifi, 
Cf ;= diag(Ci,...,Civ^), 


L := 


x>' •= 

Af . 


V, := 


J — 


T]m\ 


^ xl '' 




Nf 

''wj ^ 




e W"f^P 


(4) 


where nif = P/ = Ph «/ = P = 

2^1 Pi- 

We split the gain matrix L as 

^ = (^// %) > 

where Lff captures the first pf columns of L. This ma¬ 
trix captures the interconnection existing among follow¬ 
ers only. Furthermore, L;y contains those columns of L 
that are not contained in Ljf and thereby exhibits the 
relation between followers and leaders. 

In terms of the above quantities, the aggregated 
closed-loop system associated with the followers can be 
succinctly described via 


Let us also define the linear dynamics of each leader _ 

- (^/ + BfLffCf)4 + 

' (5) 

w/ = Cf4. 


Xf_^_^ — AiXf -H BfUf, 

w'^Ciff, NfAU-.-,N, 


(3) 


We also record the aggregated dynamics for the lead¬ 
ers as 


= A/xJ -H Bill,, 
w[ = C/x', 


where u, 6 R™ is the control command generated from 
the base-station. 
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Figure 2: The dynamics of each follower are represented by (z), 


where 


A/ 
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Cl 
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i 

t 


w 


I 

t 


diag(Aiv^+i,...,Aiv), 

diag(BA,^+i,...,BA,), 

diag(Cw^+i,...,Civ), 

/ Nf+\\ 
x/ 


I iVf + l\ 




(7) 


with dimensions and pi = 

In this paper, our objective is to address the following 
question 

Under which conditions can states of followers he 
steered into any desired values from any intial con¬ 
ditions, using the command signal u, and control law 
daii. 

To this end, we first introduce Fig. that provides 
a detailed pictorial description of the framework under 
study. It is clear that indeed there exist two levels of 
control in this framework i.e. from the base-station to 
leaders and from the leaders to followers. 


3. Reachability of Networked Systems 

We start this section by formally introducing defini¬ 
tions of reachability for each levels of control in Fig. |2l 


These definitions are adapted from the literature Il22l] for 
the purpose of the current paper. 


Definition 3.1. The follower dynamics Q is said to be 
leader-reachable if and only if for any intial state e 

and an arbirary final state f € R"-' , there exists x\, 
t 6 [fo, tf] such that 

Similarly for the dynamics ©, we state the following 
definition. 


Definition 3.2. The leader dynamics (IDl is said to be 
base-reachable if and only if for any intial state x},^ 6 
R"' and an arbirary final state 6 R”', there exists u,, 
t e [fo, f/] such that = xj^. 

The following lemma follows standard systems and 
control literature see e.g. |@]. 

Lemma 3.3. The system (|5]l/(|6ll is leader- 
reachable/base-reachable if and only if the ma¬ 
trix % = {Bf, AfBf, %, = 

[Bi, AiBi, ..., A'l'^^Bi^ has full-row rank. 

The above definitions enable us to introduce the fol¬ 
lowing lemma. 

Lemma 3.4. Suppose the system Q is leader-reachable 
and the system is base-reachable. Then there exists 
Ut, t e [fo, f/], such that for any arbirary final state f. 


Proof. Under the conditions in the lemma statement the 
reachable subspaces for the system Q and ® are equal 
to R"^ and R"' respectively. Thus, one can always con¬ 
struct a proper input signal u, to steer the states of 
the system (|5]l into any desired value. □ 

The result of Lemma 13.41 is illustrated further in the 
following example. 

Example 3.5. Consider a setup as shown in Fig. |2 For 
the sake of illustration, we suppose that all subsystems 
including followers and the leader have very simple dy¬ 
namics described as follows 

x[_|_[ = 0.2xf -H v[, / = 1,... ,4, ( 8 ) 

with v[ = i — 1,2,3 and vf = u,. 

Given the dynamics (I2]l, all subsystems are reachable. 
We let the parameters L 21 — L^i — 1, L 21 = T 23 = 2 and 
L31 = L32 = 3 . Then it is easy to verify that the follower 
dynamics are 
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Figure 3: Followers are colored in blue and denoted by fj and the 
single leader is yellow indicated by 1. 
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(9) 


It can be checked that this system is base-reachable. 
Given the dynamics (0, one can conclude that the states 
of the system can be driven into any desired point in 
the space using the input command u,. 


3.1. Leader Reachability 

In the previous subsection, we introduced the notions 
of leader-reachability and base-reachability. It is worth¬ 
while to investigate these notions when networked sys¬ 
tems attain special interconnection structures. This is 
because in different applications, subsystems may be 
linked to each other in particular forms see e.g. 

1231. ||3- Thus, in this subsection, we aim to explore 
networked systems with special structures. 

One should note that when the pairs A,, B, are reach¬ 
able, the base-reachability of the system becomes 
immediate. However, it still remains a nontrivial task 
to explore the concept of leader-reachability for the sys¬ 
tem I®. In this subsection we study this notion in more 
detail. 

The analysis of leader-reachability for the system Q 
is very intricate in general. This is because the state 
matrix Af has an involved structure. Furthermore, net¬ 
works with special coupling structures appear in many 
applications, such as cyclic pursuit ll2-5n : shortening 
flows in image processing 1261] or the discretization of 
partial differential equations 1241] . Thus, in order to pro¬ 
vide some rigorous results we study the notion of leader- 
reachability when the state matrix attains some particu¬ 
lar structures. Here, we consider two scenarios namely 


symmetric A/ and circulant A f. 

3.1.1. Symmetric Af 

Several interconnection topologies can lead to a sym¬ 
metric Af matrix. For instance, consider a scenario 
where a set of scalar subsystems are connected to each 
other based on the consensus law ||2l. 

Theorem 3.6. Suppose that the matrix Af is symmet¬ 
ric. Let Ai and v,-, V/ € {1,2,..., ny), denote eigen¬ 
values and the corresponding eigenvectors of Af and 
Bf - {by ..., b^jy. Then the dynamics I® is leader- 
reachable if Ai + Aj and yj + 0 V/, f 

Proof. In this case, the matrix Af can be written as 
QAQy where Q is an orthonormal matrix comprised of 
V; and A is a diagonal matrix containing eigenvalues of 
A f. It is easy to see that 

% = [Bf, QKQABf,..., QA’'>-^Q^Bf) 

= e ..., A"/-' G^B/) . 

% 

The matrix Q has full rank. Thus, the rank of % is de¬ 
termined by Ri that is expressed as 



(b). . 
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'v[' 
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An, 


nf-l 

'vj" 


,.T 

) 

V 

V «// 



By appealing to the theorem assumptions and the fact 
that vjvj + OTi j, the result immediately follows. 


□ 


3.1.2. Circulant A f 

In this subsection, we study the situation where the 
matrix A/ has circulant structure. This situation may 
happen naturally when the interconnection topology is 
a circulant graph see e.g ll2^ . It is worthwhile noting 
that networked systems with circulant topology arise in 
different applications such as quantum communication 
ll27n and complex memory management 11281] . 

The following example illustrates a situation where 
the matrix A/ acquires a circulant structure. 
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Figure 4: Followers are colored in blue and denoted by and the 
sole leader is yellow indicated by 1. The weighting coefficients on 
connecting links are represented by a,-. 


Example 3.7. Let us consider a network consisting of 
four identical single-output-single-output (SISO) sub¬ 
systems. We suppose the dynamics for each subsystem 
are expressed as 


= flxj + bV,, 

i - I,... ,A- 


onalizable by the Fourier matrix 
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1 

O) 



d>=^ 
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af 



,1 
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4>2 

\fnfJ 


where u - denotes a primitive «/-th root of 

unit and 0, denote rows of <1). Note, that d) is both 
a unitary and a symmetric matrix. It is then easily 
seen that any circulant matrix L has the form Af - 
4>diag(pL(l),pi(w),... = OFd)* where 

Pl{z} As a consequence of the preced¬ 

ing analysis we obtain the following result. 


Theorem 3.8. Suppose that the matrix Af is circulant 
and Bf = (b^^, Then the dynamics is 

leader-reachable iffjb^^ + 0, Vi,/ 

Proof From the above analysis, one can write 


with \a\ < 1. vj = Z)=i Lijxl, i — 1,2,3 and 
As shown in Fig. 0 the interconnection parameters 
i.e. Ljj are set as L \2 — T 23 ~ rri, /13 = Z /21 ~ B 32 — 

L 32 = 1 x 3 , Li 4 — b and L 24 = F 34 = 0. Then it is easy 



' a 

ai 

Q'2' 


'b\ 

to verify that Af — 

Q'2 

as 

a 

Q'2 

O'! 

G. 

and Bf — 

0 

loj 


set parameter of dynamics and topology to be a — 0.2, 
b — ai — as — 1 and 02 — 0.5. Then it can be checked 
that the whole network depicted in Fig. ^is reachable. 

As mentioned earlier, the matrix Ay in the above ex¬ 
ample has a particular form known as circulant. Thus, 
we now investigate in more detail a scenario where the 
matrix A/ has circulant structure i.e. is of the form 


f - Circ(Q'o, 

...,a 

Of-l) 




' act 

a\ 


^nf~2 



Q '«/—1 

ao 

ai 


2 


Q'2 



ao 

ai 


, O'! 

as 


^Hf — l 

ao 


% = {Bf, (DFO^B/,..., OF"/ 

= d) (d)*B/, Fd)*B/,..., F"f ‘d)*B/) 

S 

Now by using the same argument as in the proof of The- 
orem l3.6| the result immediately follows. □ 

3.2. Generic Reachability 

The previous subsection examined the leader- 
reachability and base-reachability notions for special 
network structures. In this subsection, we show that 
these properties hold in almost all cases. To this end, 
we hrst need to define the parameter space 0 as 

0 ={vec (Ai,...,Aiv),vec (Bi,..., Bjv), 
vec (Cl,..., Cat) , vec(L)). 

Then we recall the notion of generic set from 10 . A 
subset of the parameter space 0 is said to be generic if 
it is an open and dense in 0. We now use this notion to 
introduce the next results. 

Theorem 3.9. The systems © and are leader- 
reachable and base-reachable on a generic subset of the 
parameter space 0. 


It is well-known that circulant matrices ll29n are diag- 
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Proof. First, one can easily find a set of matrices 
etc., such that the associated matrix % attains full- row 
rank. Second, let cr, i = 1,..., nftnf denote the columns 
of % defined in Lemma [33] Then note that the system 
(|5]l is not reachable if and only if 

det{r)=0, (11) 

where F e and the columns of F are constructed 

by selecting any nj choice of cr,. Then the set of ze¬ 
ros of (HHl defines a proper algebraic set. Therefore, 
its complement, which is associated with all reachable 
systems, is the complement of a proper algebraic set and 
hence is open and dense in the parameter space. The lat¬ 
ter is equivalent to the statement of the theorem. Finally, 
note that those parts of the theorem statement asssoci- 
ated with the system (|6ll become trivial in the light of 
pages 44-45. □ 


more general instances. Another problem involves 
studying reachability for a scenario where interconnec¬ 
tion matrices assume only zero and free entries. This 
problem is highly related with the structural controlla¬ 
bility problem studied in the literature ll32|] . Another 
interesting issue is associated with control energy of 
the whole networked system. In particular, we are in¬ 
terested in designing topologies such that reachability 
is preserved but the deployed control energy remains 
within some given boundaries as well. 
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